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Abstract 

The notion of a 1-vertex transfer matrix for multi-dimensional codes is 
introduced. It is shown that the capacity of such codes, or the topological 
entropy, can be expressed as the limit of the logarithm of spectral radii of 
1-vertex transfer matrices. Storage and computations using the 1-vertex 
transfer matrix are much smaller than storage and computations needed 
for the standard transfer matrix. 

The method is applied to estimate the first 15 digits of the entropy of 
the 2-dimensional (0,1) run length limited channel. 

In order to compare the computational cost of the new method with the 
standard transfer matrix and have rigorous bounds to compare the esti- 
mates with a large scale computation of eigenvalues for the (0,1) run length 
limited channel in 2 and 3 dimensions have been carried out. This in turn 
leads to improvements on the best previous lower and upper bounds for 
that channel. 
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1 Introduction 

In classical information theory the emphasis was on one-dimensional channels. 
This is the natural channel type when one is considering sequential information 
transfer and information storage on effectively one-dimensional media, such as a 
magnetic tape. However, in modern information technology higher dimensional 
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channels are becoming more and more important. The simplest example is of 
course information storage on a surface, as on a CD or DVD. Future devices 
seem likely to move on to three-dimensional storage media as well. 

Just as for the classical one-dimensional channels one still wishes to construct 
codes to protect data from errors and to find the channel capacity given by the 
code. In higher dimensions computing the exact capacity becomes much more 
difficult and even for very simple codes we do not know the exact value. The 
typical example is the run-length limited channel. Consider a two-dimensional 
square grid where each point can be assigned a value of either or 1 with the 
restriction that two points which differ by one in exactly one coordinate cannot 
both be 1. This channel has been studied in both information theory [NZ99| . 
combinatorics |CW98| and physics [BET80| . In statistical physics this has been 
studied in terms of lattices gases, primarily through non-rigorous methods and 
simulation. However a sequence of authors |CW98| IKZ99t iFPOSl INZ99| INZ03) 
have developed methods for establishing rigorous upper and lower bounds by 
using transfer matrices. The drawback with these methods is that the cost of 
achieving a given precision is exponential in terms of the precision. It is possible 
to use symmetries |LM08j to speed up the computation but typically the cost 
remains exponential, with improved constants. 

Hence it would be desirable to be able to establish good estimates for the 
capacity of a code before deciding whether to invest the time needed to bound 
its capacity rigorously. In this paper we present a method for obtaining such 
estimates. The method uses a so called 1-vertex transfer matrix which adds one 
vertex at a time to the graph, rather than whole rows as in the standard method. 
We prove that under certain conditions on the code the largest eigenvalue of 
this matrix converges to the channel capacity. The drawback is that we do not 
get easily computable bounds for the capacity, but as a practical example will 
demonstrate one can get estimates which agrees with the rigorous bounds at a 
fraction of the computational cost. Hence this method can be used as a tool 
for quickly testing many different candidate codes in order to identify promising 
coding schemes, for which one can later establish rigorous bounds as well. 

In order to help evaluate the accuracy our new method we have also improved 
the known bounds for the capacity of the two and three-dimensional run-length 
limited channels, or hard core-lattice gases as they are known in the physics 
literature. 

1.1 Mathematical preliminaries 

Many channels and models from statistical physics can be described in terms of 
restricted colourings of an underlying graph, often a lattice such as Z'', or more 
generally in terms of weighted graph homomorphisms ^BCL +06. FLS07[ ILM08| . 

We now explain the main ideas and results of our paper for the two-dimensional 
grid Z^, where the colouring conditions are symmetric and isotropic. Let 
A = (y, E),V — {1, . . . ,k} be an undirected graph on k vertices, where vertex 
i is identified with the colour i. Two neighbouring points p = (pi,_P2) ,q = 
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{qi:'12)~^ £ i-e. \pi — gi| + |p2 — 92! = 1, can be coloured in colours i,j gV 
if and only if (i, j) G E. We assume that A has no isolated vertices. 

The standard transfer matrix is defined as follows. For a positive integer 
n G N denote by (n) = {1, . . . , n}. Then : (n) V is viewed as a colouring 
of (n) in k colours. View (n) as n points on the real line, where i,j S (n) 
axe neighbours if and only if \i — j\ — 1. Then cj) e CA((n)) is an allowable 
colouring if {<j){i) , G E whenever \i — j\ — 1. Let N{n) = #CA((n)) be 

the cardinality on CA((n)). Note that N{n) = 0(/9(A)"), where p(A) is the 
spectral radius of A. Let (/), "0 € CA((n)) be two allowable A colourings of 
(n). View {(pjip) as a colourings of integer strip t : (n) x (2) C 1?, where 
t((i, 1)) — T{{i, 2)) = ipli) for i 1, . . . , n. Let t^_^ = 1 if t is a A-allowed 
colouring, i.e. £ for i = 1, . . . , n, and otherwise i^,^ = 0. Then 

Tn,2 = [t't>,4']rp,ipeC&{{n)) & {0, l}^(") ^("■) is the transfer matrix, which defines 
the allowable colourings of the infinite strip (n) x Z C Z^. An important and 
useful observation is that Tn^2 is a symmetric matrix. 

Let /o(T„_2) be the spectral radius of T„^2- It is well known that the sequence 
log/5(T„_2) is subadditive in n. Hence the following limit exists, and it is called 
the topological entropy of with respect to A, e.g. |Fri97[ lFH03l IFP05] : 

h,iA) lim }2l£^. (1.1) 

n — >oo 77, 

Furthermore, one has the following known upper and lower bounds, see e.g. 
[FH97llWi03] 

iogp(rp+29+i,2) - l0gp(r2^+i,2) ^ ^^^^^ _^ iogp(r„,2) 



l<p,n, 0<q. (1.2) 

In many theoretical derivations, e.g. [Lie67j . it is useful to consider the pe- 
riodic colouring CA,pGi((n}) C CA((n}), where each colouring e CA((n)) sat- 
isfies the additional condition (</)(!), 0(n)) e E. So CA,per((n)) is a A-allowable 
colouring of the torus 'E/{ri). Let iV(n,pcr) = #CA,pcr((n)) be the number 
of periodic A-colouring of CA,pcr((n)). Then r„,2,pcr = [t^,4']<p,i>&c&,p^A{n)) G 
{0, ij.^(".pct)xJV(n,pcr) ^^iq transfer matrix for the allowable colourings of the 
infinite torus (Z/(n)) x Z by A. Note that r„,2,pcr is a principal submatrix of 
Tn,2, hence symmetric. Furthermore p(T'n, 2, per) < p{Tn,2)- Also, the following 
inequalities hold [FP05j 

l0gP(^p-K2g,2,per) - logp(T2g,2 

p - 2 _ 

l0gp(T2„,2,pcr) „ , , ^ /, „^ 

— ,0 < q, 1 < p,7i, (1.3) 

where /c(To_2.per) = p(A). Note that the upper boimd in (|1.3p is an improvement 
of the upper bound in p.2p for an even n. 
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We now define the 1-vertex transfer matrix 



Sn,2 = [s^,^]0,^ec.((„)) e {0, l}^(")x^(«), (1.4) 

where 

S4>,^p = 1 iff "ipii) = (l>{i + 1) for i = 1, . . . , n — 1, and 

(</)(l),^(n)) ei?. (1.5) 

Sn,2 is the transfer matrix corresponding to the A colouring of Z winded up on 
a slanted torus, given by (71 + 1) x Z, where the points [n + 1, i) and (1, i + 1) 
are identified for each i 6 Z. Note that Sn.2 is a sparse matrix, where each row 
and column of Sn,2 has at most k neighbours. We show that 

lim logp(52„+i,2) = /i2(A). (1.6) 

n — >OQ 

Thus \ogp{Sn,2) is an approximation of /12(A), and it can be computed much 
faster, and with much less memory than logp(T„.2) and log/9(T„^2,pcr)- The 
only drawback for computing the values of logp(5'„_2), is that we do not have 
very sharp inequalities of the type p.2p or (|1.3p . One of the reasons is that Sn,2 
is not a symmetric matrix and can have nonreal eigenvalues. We do have the 
following inequalities 

logp(T„-l,2,por)) ^ , 10 ^ ^ 
< \0gp[Sn,2) < 

n 

. l0gp(T„,2) logp(T„+i,2,per). „ , „^ 

mm( ■ — , — — j, 2 < n, (1.7) 

n n 

which imply (|1.6p . 

The undirected graph $, which can be viewed as a symmetric digraph on 
two vertices 

^={V,E), y = {l,2}, i?-{(l,2),(2,l),(2,2)}, (1.8) 

corresponds to the checkerboard constraint used in |NZ03| and hard core lattice 
gas model in statistical mechanics. (Usually 2 is replaced by 0.) We will use the 
1-vertex transfer matrix to give a heuristic estimate of the entropy of the two 
dimensional hard core h2{'^) up to 15 digits. Using the upper and lower bounds 
(|1.2p and (|1.3p we show that the 15 digits estimates agree with the correct values 
of the /i2($). Previously the value of /i2($) was known to 10 digits [NZ99| . 

1.2 Overview 

We now briefly survey the contents of the paper. In §2 we give the full details of 
the two-dimensional isotropic symmetric case discussed above. In §3 wc discuss 
the computational results for the two-dimensional checkerboard constraint/hard 
core lattice gas. In §4 we discuss the characteristic polynomial and the eigen- 
values of Sn.2 for the hard core model. In §5 we discuss a two-dimensional 
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1- vertex transfer matrix P„.2 for nonisotropic and nonsymmetric colouring of 
1? . We show that logp(P„_2) is an estimate of the two dimensional-capacity, 
or entropy, if the colouring of 1? has a friendly colour. In §6 we show that the 
results for two dimensions apply also to the three-dimensional 1-vertex matrix. 
In the last section we show that 1-vertex model can also be used to estimate 
the monomer-dimer model in any dimension d. 



2 The Two-dimensional isotropic symmetric case 

Recall that the graph A = (y,i?), where the set of vertices V is identified with 
k colours (fc). We allow loops (i, i) e E, which means that two adjacent vertices 
of 1? can be coloured with the same colour i. If i G y is an isolated vertex, this 
means that no vertex in 1? can be coloured in the colour i. Hence we will deal 
only with graphs A which do not have isolated vertices. 

Theorem 2.1 Let A = (V, -E) he an undirected graph on = k > 2 
vertices, where self-loops are allowed, with no isolated vertices. Then |j. 7p and 
fT^) hold. 

Proof. Identify the entry s^,^ = 1 of Sn.2 with an allowable A-colouring of 
the following L shape in 7? 

a;:{(l,l),...,(n,l),(l,2)}^(fc), (2.1) 
iu{{i, 1)) = i = 1, . . . , n, u;{{l, 2)) = ^(n). 

More generally, consider the entries of the matrix 5*^2 = [^lplf,]4>.4>GC&{{n))- Re- 
call that 

m 

0i,...,0„+ieCA((n+l)) i=l 

Clearly, Hili s<i>i,4>i+i = 0, 1. Then YYiLi s^i.^i+i = 1 if and only if one has a 
A- allowable colouring r G CA((n + m}) such that 

(tW,tO-)) ePif =n. (2.2) 

Assume that YiiLi ■S0i,0i+i = 1- Then we can colour the following part of (n) xZ: 

(l,l),...,(n,l),(l,2),...,(l,g),...,(/,g), 

n + m 



q 



I — n + ni — {q — l)n. 



using T. Let 1 = (1,...,1)^ be a vector whose all coordinates are 1. The 
number of coordinates of 1 will depend on the square matrix A — [a.y] G 
j^MxM^ Observe that l^Al = Ej^.j^iOy- Hence l'^ S^^^^'^ is the number of 
all A allowable colourings r G CA((n + m)) satisfying the condition ()2.2p . In 
particular, 1^ ^''"l is the number of different colourings of the rectangle 
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(n) X (q) induced by t S CA(qn) satisfying (|2.2p . Similarly, l^T^^l is the 
number of A-allowable colourings of the strip (n) x q. Hence 

logl^^i^a"'^"! 

logp(5„.2) = lim < 

9^00 ((I — \jn 



See jFri03[ Proposition 10.1] for details. This inequality establishes the first 
part of the upper bound in (|1.7p . The equality (|l.ip yields the inequality 

lim sup log p(S'„,2 )< /12(A). (2.3) 

n — *oo 

We now show the inequahty logp(S'„,2) < '°sp(^"+i.''.p") . Let m = - l)n + 1 
and consider the colouring of (n) x(g)U{(l,(7+l)} induced by colouring r g 
CA((nq+ 1)) satisfying condition (|2.2p . Note that the number of such colourings 
is l^iS'^'^^^^"^^!. We now extend each colouring t to the colouring of (".+ 1) x {q) 
viewed as a colouring of the torus (Z/(n + 1)) x {q) as follows. The colouring 
of {n) X {q) is given by r as above. Then the colour of the point {n + l,i) is 

given by T(m + 1) for i = 1, . . . , g. Hence < l^T^:^i_2,perl- Use 

[FriOSi Proposition 10.1] as above to deduce the second part of the upper bound 
in (O). 



We now show the lower bound in p.7p . Recall that l^T^jZi 2 pcr^ 
number of colourings of the rectangle w : (n — 1) x (g) on the torus (Z/(n — 
1)) X {q). Each u) induces the following t G CA((nq)) satisfying (|2.2p : 

T{i + U - I)"-) ^((«,i)), T{jn) = w((l, j)), 
j = 1, ... ,71 - 1, j = l,...,q. 

Hence l^T^Zl 2 poi-l ^ l^'5'-i^2 ^''"l- The above arguments show the lower in- 



equality in (|1.7|) 

Combine the upper bound in (jl.3p and the lower bound in (jl.7D to obtain 

, / ^ logp(T2„,2,por) , -I ^ /o A\ 

r/«2(A) < — TT"^ ^ logp(S'2„+i,2). (2.4) 



2n + 1 2n+ 1 

Hence liminf„_>oo logp(S'2n+i.2) > /12(A). Combine this inequality with (|2.3p 
to deduce (fL6l). □ 



3 The Two dimensional run length limited chan- 
nel 

We will now apply the above results to the following simple symmetric digraph 
$ on two vertices: 
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Identify the red colour with the state 1 and the blue colour with the state 
2, which is usually identified with the state 0. Then C$(Z'^) consists of all 
colourings of the lattice in blue and red colours such that no two red colours 
are adjacent. In terms of codes this correspond to the checkerboard constrain 
used in e.g. |NZ99j and the simplest hard core model in statistical mechanics. 

"0 1 " 
1 1 



The adjacency matrix A(<I') is 



It is well known that the one- 



dimensional entropy corresponding to C<i,(Z) is the logarithm of the golden 



ratio 



1 + 75 



Hence, sometimes $ is referred as the golden ratio graph. 



3.1 Computational results 

The topological entropy /12(A) of the hard core model is known within the 
precision of 10 digits [NZ99]. As in the physics literature, e.g. |Lie67| . we will 
discuss the values of e''^^*^ The inequalities obtained in |NZ99| are equivalent 
to 

1.50304808247497745859985734 

< e''^(*) < (3.1) 
1.50304808257186797788004159 

We have computed eigenvalues for the standard transfer matrix, the periodic 
transfer matrix and finally for the 1-vertex transfer matrix. Let us examine the 
results. 

Table[l]gives the computed values of p{Tn.2),n — 2, ... ,28 and p(T„^2,pcr), n ~ 
3, . . . , 36. We observed the following facts on the two computed sequences. First 
the sequence p^t'"'^\) is an increasing sequence for n > 10. Note that in view 

of the lower bound given in 111.21) we know that jg a lower bound for 

e^^^'^l Hence 

1.50304808247533226432204921 < e'*^^*). (3.2) 

The sequence p(T2„i,2,pcr)^ is decreasing for to = 2, ... , 18. In view of the 
upper bound in (|1.3p it follows that 

g/i2(<E>) < 1.50304808247533992728837255. (3.3) 

The above two inequalities give the correct 15 digits of the value of e'*^*-*-' . Note 
that the lower bound in (|3.ip is closer to the correct value of e''2(*) than the 
upper bound. It is plausible to assume that the same observation applies to the 
inequalities (|3.2j|3.3p . 

The sequence p(T'2m+i,2,pei )^™+^ increases for m = 1, . . . , 17. If this sequence 
always increases, in view of (II. 2p . it would follows that p(T2m+i^2,pGr)'™+^ 
is a lower bound for e''^^*'. The lower bound given by (|3.2p is bigger than 

p(T35,2,pcr)^. 
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n pjTnq) 

2 2.414213562373095 

3 3.631381260403638 

4 5.457705395965834 

5 8.203259193755024 

6 12.32988221531524 

7 18.53240737754881 

8 27.85509909631079 

9 41.8675533182809 



10 62.928945725187815984970517564242 

11 94.585231204973665631062351227180 

12 142.16615039284113705381555339180 

13 213.68255974084561463042598863826 

14 321.17516167688358891589859286791 

15 482.74171089714185369639722005855 

16 725.58400289480913382756934371728 

17 1090.5876442258184943798276273781 

18 1639.2056674249062545759683245949 

19 2463.8049352057025354985027848902 

20 3703.2172834541914402106141013810 

21 5566.1136368853314325759144845043 

22 8366.1364287602952611690001026376 

23 12574.705316975186002047579953615 

24 18900.386714371918513370098148691 

25 28408.190009078957569653791590282 

26 42698.875519741019043924030420844 

27 64178.462973799644995496644648926 

28 96463.315708983666788807112233379 
29 

30 
31 
32 
33 
34 
35 
36 



3.302775637731994646559610633735247 
5.156325174658661693523159039366916 
7.637519478750677316156696280583774 
11.55170956604814509016646221019832 
17.31622927332784947478739705217656 
26.05798609193972135567942994470689 
39.14578184202813825907509993927013 
58.85193508152278064182392832406795 
88.44780432952028084071406736758034 
132.9477940474849517182393096863462 
199.8224640440179428924580367714202 
300.3458520273548324890314287157792 
451.4321236042340748832899060864991 
678.5256693463314967782756777455377 
1019.855674771119057225300394186046 
1532.892835974578082578218246454006 
2304.011134761604258032847423262351 
3463.039870272410387224398919252810 
5205.115189611387576190086821772236 
7823.538578192028601159488379441279 
11759.15453623673826922032891077820 
17674.57476300121240825274824636313 
26565.73564566649640784345844846860 
39929.57806437579207220381471608921 
60016.07571363818523121568140477488 
90207.04754031656425802350521860206 
135585.5298162229950461965077280634 
203791.5706122926277969020818385026 
306308.5294259292544744183247215849 
460396.4478048022575136612396701088 
691997.9980476929053415088280918978 
1040106.264045025628338539352181110 
1563329.725741562336590052426628794 
2349759.746553886953259135919605940 



Table 1: Spectral radii for standard and periodic transfer matrices 



Table [2] gives the values of p{Sn,2) for n = 25, . . . ,40. We found that the 
sequence ^(52;, 2), ^ = 1, . . . , 20 increases while the sequence ^(52;-!, 2) decreases 
for I = 2, . . . , 20. Assuming this behaviour for all values Z £ N we deduce that 

p[S2i,2) < e''^(*' < p{S2i-u2), for all / e N. (3.4) 

The above ansatz for / = 20 gives the value of e''^'^*-' with a precision of 15 
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Ih A/'f^Tl 71 
J_J V ll^il / 1 






26 




5030480824559338746449982720899 


28 




503048082471 3491 1 71 046098760579 


30 




5030480824745080695008293589330 






■50304808247'il 60574386^692042299 


34 




'S0304808247'S29628788230921 ^8144 


36 


I 


5030480824753246862738777999703 


oo 


1 
i 




40 


1 


.5030480824753319235292607404167 


Odd n 






39 


1 


.5030480824753330032275278142102 


37 


1, 


.5030480824753357484850986619224 


35 


1, 


.5030480824753487657242129983806 


33 


1, 


.5030480824754108025759894900493 


31 


1, 


.5030480824757081424841278582465 


29 


1, 


.5030480824771425174857112752302 


27 


1, 


.5030480824841133358901685021830 


25 


1, 


.5030480825182810708944214989118 



Table 2: Spectral radii for 1- vertex transfer matrices 

digits, which coincides with the exact values given by (13. 2113. 3p . More precisely 
the heuristic upper bound ^(£'39, 2) is slightly better than ()3.3p . and the heuristic 
lower bound given by ^(5*40, 2) is slightly worse than p.2p . 

3.2 Computational costs 

We now compare the computational resources needed in order to compute the 
eigenvalues for the 1-vertex transfer matrix and the standard transfer matrix for 
cycles. The computations were done in 31 digits precision, both were done on 
the same machine, and used Perron iteration for computing the maximum eigen- 
value. The standard and periodic transfer matrices were compressed using the 
method of |LM08| thereby reducing the amount of RAM needed considerably. 
For the = 40 1-vertex transfer matrix the computation took 48 CPU-hours, 

Matrix Time RAM 

TV = 40 1-vertex 48 CPU-hours 0.5GB matrix, two 4GB vectors 
= 36 periodic 988 CPU-hours 203GB matrix, two 20MB vectors 

Table 3: Computational costs 

used 0.5GB RAM for the matrix and also needed two vectors or the Perron 
iteration, each using 4GB RAM. For the C36 standard transfer matrix the com- 
putation took 988 CPU-hours, the automorphisms compressed transfer matrix 
used 203GB RAM and also needed two vectors, each using 20MB RAM. 
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We see that in order to reach a high prescision estimate of the asymptotic 
capacity the 1-vertex transfer matrix used less memory and less CPU time. 
The resources needed for the largest 1-vertex transfer matrix used here is today 
available on many larger workstations, while those needed for the largest peri- 
odic transfer matrix still requires a larger cluster. This means that the 1-vertex 
transfer matrix can first be used on a smaller inexpensive machine in order to 
find interesting examples of codes so that the more costly large computer will 
only be used when an interesting candidate has been found. 



4 The General Two dimensional case 

Let r — {{k),E) be a directed graph, abbreviated as digraph, on the set of 
vertices V = {k), where E C (k) x (k). Let X C Z. Then (j) : X ^ (k) is viewed 
as a k colouring of X. cf) is F-allowable colouring of X if , + I j) e E 
whenever i,i + 1 G X. Denote by Cr(X) the set of allowable F-colourings 
of X. Note that a colour j G (fc) appears in e Cr(Z) if and only if the 
vertex j of F is contained in strongly connected component of F. Hence we 
assume that G is a disjoint union of strongly connected graphs. Recall that 
log#Cr((n)), n — 1,2,..., is a subadditive sequence. Hence the Z-entropy 
induced by F is given by 

hm-piT)^ lim (4.1) 

n — *oo Ji 

where p(F) is the spectral radius of F, i.e. the adjacency matrix corresponding 
to F. See for example Tri97, Fri03 . 

Let Fi = i{k),Ei), T2 {{k), E2), Ei, E2 C (fc) x (fc) be two directed graphs 
on the set of vertices V = (k). We assume that each F^ is a disjoint union of 
strongly connected graphs. Let X C 1?. For each i £ Z denote 

Xi,,^XnZx{i}, = {i}xZ. 

View (p : X (k) as a fc-colouring ofX. Then is an allowable F = (Fi, F2)- 
colouring of X if (j)\Xi^i, (j>\X2,i are Fi, F2-allowable colourings respectively, for 
each i G Z. Let Cr(X) be all F-allowable colourings oi X. It is known that the 
sequence log#Cr((ni) x (n2)) is a subadditive sequence in one variable, where 
the other variable is fixed. Hence the Z^-entropy induced by T is given by, e.g. 



,,(r). lim l"g#Cr((n0x(n2))^ 



log#Cr((ni) X (n_2)) ^^ 2) 



nin2 



for all rii, G N. 

Denote {i'} = {l,2}\{i}. Let Rn,i = [^^.V.d^.iAeCr., ((n)) be the following 
(0, 1) transfer matrices for i = 1,2. r^,^^i = 1 if the colouring of x (2), such 
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that the colouring of {(1, 1), . . . , {n, 1)} and {(1, 2), . . . , {n, 2)} is given by (f> and 
ip respectively, is (r^', ri)-allowable. Hence 



, fj, , r log#Cr((ni) x (n)) 
\ogp{Rn.i)= lim ; 

log#Cr((n) X (n2)) 



logp(i?„,2)= lim 



712— *00 



"2 



h,(T) = lim l^I^i^ < ]2iPi^^ (4.3) 
i = 1,2, for all n e N. (4.4) 

Note that for general Fi, r2 we do not have lower bounds that converge to h2{T). 
In fact, there are examples that the computation of h{T) is undecidable, e.g. 
|Fri97[ [rVi03| . One has good lower bounds, similar to (|1.2p . if Ti is undirected 
for i = 1 or i = 2. Note that the isotropic case discussed in §2 is given by the 
condition that Fi = F2 is an undirected graph A. In that case r„.2 = Rn,i = 

Rn,2- 

We now discuss the 1-vertex transfer matrix for a given T. In this case we also 
have two transfer matrices Pn,i,Pn,2 which are (0,1) matrices. For simplicity 
of the exposition we discuss only Pn.2- Let P„^2 = b0,i/;,2]0,^eCri ((n))- Then 
Pip,i',2 = 1 if and only if the conditions given in p.Sp hold, where E — E2. The 
proof of Theorem 12.11 yields the inequality 

logp(F,,2)<i^^^^fornGN. (4.5) 
n 

Hence 

ft.2(r) > limsuplogp(P„,2)- 

n — >OQ 

It is an interesting question when 

h2{T) = lim logp(P„,2). (4.6) 

n — *oo 

Theorem 12.11 implies that the above equality holds if Fi — F2 is an undirected 
graph. We now give another condition for the equality (|4.6p . 

A colour j e (fc) is called a friendly colour, if (j, i), (i, j) G i?i fl i?2 for all 
i € (k). The existence of a friendly colour means that Fi and F2 are strongly 
connected graphs. Note that for the hard core model the colour 2 is friendly. 

Theorem 4.1 Let Fi = ((fc},i?i),F2 = ((fc),i?2) be two digraphs with a 
friendly colour. Then for each n > 1 

l0gp(i?„,2) \ fA '7\ 

— ^ < logp P„+i,2). 4.7) 

n + 1 

Hence ^4-6^ holds. 
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Proof. As in the proof of Theorem 12.11 we deduce that 
#Cr((n) X (m)) = I'^K^^'l. 

Observe next that l^P^^'Jll 2'^™ ^■'l is the number of ah u E (((n+l)m)) such 
that {uj{i),uj{n + l+i)) e £'2 for i = 1, . . . , (TO-l)(n + l). Let r £ Cr((n} x (m)). 
Extend r to f : (n + 1} x m by letting T{{n + 1, i)) = j for i = 1, . . . ,m, where 
j is a friendly colour of F. Then each such f is induced hy uj E Cpi (((n + l)m)) 
satisfying the above additional conditions. Hence 

The arguments of the proof of Theorem 1 2 . 1 1 vicld the inequality (|4.7p . Combine 
this inequality with the inequality (j4.5p and the characterisation of /i2(r) in 
(1131) to deduce g^l). □ 



5 The Three dimensional case 

Let Ti = {{k),Ei),Ei C (fc) x (k) be a digraph, which is a disjoint union 
of strongly connected graphs, for i = 1,2,3. Denote F — (ri,r2,r3). Let 
e,; — {Sii,Si2,Si3)^ ,i — 1,2,3 be the standard basis in Z"^. For X C Z'^ the 
colouring (f) : X ^ (k) is called F-allowable if (f>{j + e^)) g iJ^, whenever 

jj + ei E X, for j £ and i = 1,2,3. Denote by Cr(X) all F-allowable 
colourings of X. Recall that the sequence log#Cr((ni) x (n2) x (ua)) is a 
subadditive sequence in one variable, where the other variables are fixed. Hence 
the Z^-entropy induced by F is given by, e.g. |Fri97[ lFri03j . 

/13(F) = hm l"g#Cr((nr}x(n2)x(n3)) ^^^^^ 
"1, "2, "3^00 f^l^^2n3 

^ log#Cr((ni) X (n2) x (n3)) 

~ 711712713 

for all 771,712,773 S N. Let n = (711,712) E N^. Denote (n) ~ (711) x (712). As in 
the two dimensional case one can define the transfer matrices -Rn,i, ^n,2, ^n,3 
which are (0, 1) matrices. For simplicity of the exposition we discuss only 

^n,3 = ['^0,V>,3]</.,^(EC(ri.r2)((n))- 

f4>,ip,3 = 1 if the colouring of (n) x (2), such that the colouring of (n) x {1}, (n) x 
{2} given by and ip respectively, is F-allowable. Hence 

, /n ^ r log#Cr((ni) x (na) x n3) 
logp(i?(„i,„2),3) = lim , 

ri3^oo 713 

;i3(r)= lim l0gP(i?(n.,n.),3)^l0gp(i^(n..n.),3)^ ^^.^^ 
ni,n2^oo 77i7l2 7li7l2 
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for all ni , 712 G N. 

We now discuss the 1-vertex transfer matrix for a given T. In this case 
we have three transfer matrices Pn,i, Pn,2, Pn,3 (0,1) matrices. For simphcity 
of the exposition we discuss only Pn,3- Let Cri{{nin2)) be the subset of all 
Fi-allowable colourings of G Cri((nin2}) satisfying the additional condition: 

(0(i), + i)) £ E2 ioT i = 1, . . . , ni(n2 - 1). (5.3) 

The condition (|5.3p yields that the colouring given by (j) on (nin2) induces a 
(Fi, r2)-allowable colouring of (n) x {1} as discussed in the previous section. 

Let P„,3 = [P0,V,3]0,v,6Cri((nin2»- ^ben p0,^,3 = 1 if and only if V(i) = 
0(i + 1) for 1 = 1,..., 71171,2 — 1 and 

(0(1), ^(771712)) e£;3. (5.4) 

The condition (|5.4p yields that if we colour (n) x 1 in and (1, 1, 2) in the colour 
■i/j(7ii772), we obtain a F-allowable colouring of (n) x {1} U {(1, 1, 2)}. 

Observe that iTpni^"2(m-i) ^ ^Qj^gjgi^g Qf qH ^ ^ Cri(nin2m) satisfying the 
above "periodic" conditions 

1. (0^(7), W(7 + Til)) e £'2, 7 = 1, . . . , 771 (77 2 777 " 1)- 

2. {uj{i), uj{i + 711772) e i?3, 7 = 1,..., 771772(777 - 1). 

Hence each such uj induces a F-allowable colouring of (n) x (777}. Therefore 

The proof of Theorem 12.11 yields the inequality 

1 /D \ ^ 10gP(i?(„i,„2),3) r ^ M /r rN 

log/9(P(„j,„,),3) < ^ '-^ for 771,772 e N. (5.5) 

77 1 772 

Hence 

/73(F) > limsup logp(Pn,3). 

ni ,712 — 

It is an interesting question when 

/73(F) = lim logp(P(„^,„,),3). (5.6) 

ni,n2 — >oo 

A colour j e (fc) is called a friendly colour, if (j, i), (7, j) £ £'1 n i?2 H -E3 for 
all 7 G (fc). 

Theorem 5.1 Let Fi = ((fc),i?i),F2 = ((fc), P2), F3 he three digraphs with 
a friendly colour. Then for each 77i, 772 > 1 

l0gP(-^(ni,n2),3) ^, . .^„. 

(77l + l)(772 + l) - l°g^(^(»+l,-+l),3)- (5-7) 

Hence i5. 6\) holds. 
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Proof. Let <j> G Cr((ni) x (n2) x (m)). Extend (j) to the colouring cf) : 
{ni + 1) X (77.2 + 1) X (to) by colouring the additional points in a friendly colour. 
Note that (j) induces the colouring uj G Cpi ((ni + l)(n2 + l)ni) such that 

{uj{i),uj{i + ni + 1)) e E2, 
i^l,..., {ni + l)(n2 + l)m - ni - 1, (5.8) 

(5.9) 

{iuij),u;{j + (m + l)(n2 + 1))) e E3, (5.10) 

J = l,...(ni + l)(7l2 + l)(TO-l). 



Hence 

Therefore (|??7)) holds. Use and to deduce ^EM- ° 



-|_T^m-l -j^ ^ -|^Tp(ni + l)(n2 + l)(ni-l)-|^ 
(ni,n2),3 — (ni+l,n2 + l),3 



We now discuss briefly the isotropic symmetric case, i.e. Fi = r2 = Fa = 
A = {{k), E) is an undirected graph with no isolated vertices. Then the transfer 
matrix T'(„i,„2):3 is equal to i?(„i^„2),3. Denote by T(^ni,n2),3,pcr the transfer 
matrix corresponding to all (^1,^2) periodic colourings, which are A-allowable 
colourings of (Z/rti) x (Z/n2). Note that T'(ni,n2),3,per is a principal submatrix 
of r(„i,„2),3. Recall the following improvement of the ((521) [M97[ iFHOSl IFPOSj 



h^iT)= hm ]^SPiThnM^^ 
ni,Ti2^oo 4nin2 



l0gp(r(2„i,2«2),3,per) 



(5.11) 



4nin2 
for all ni, ?i2 £ N. 

Let 5'(„^ „,) 3 = P[ni,n2),3 be the 1-vertex transfer matrix corresponding to 
A. A given A-allowable colouring on Z x Z x (to), which is (ni, 712) periodic on 
each Z X Z X {i} for each i G (to), induces a colouring 4> G CA((ni + 1) x (n2 + l) x 
(m)). This colouring corresponds to the colouring u G CA((ni + l)(n2 + l)m) 
that satisfies the conditions (|5.9p . where E2 — E3 = E. Hence we have an 
analogue of l|5.7p 

logP(^(ni,ri2),3,pcr) ^ , / r< \ /r r,\ 

(ni + l)(n2 + l) - l°S^(%^+i-^+i)^3). (5.12) 
Use (IOT|) . (IF3D and ((121) to deduce 

lim logp(S'(2„i+i,2n2 + l),3) = /J3(A). (5.13) 

ni ,712 — >-C)0 



6 The Three-dimensional Run Length Limited 
Channel 

The capacity of the three-dimensional channel corresponding to the isotropic 
symmetric case of Z"^ with the same digraph as in Section [3] is the three- 
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dimensional (0, 1) run length limited channel. This channel was considered 
in |NZ03| where the transfer matrix methods previously used for the two- 
dimensional case was extended to find the bounds 

1.43644 < e''^(^) < 1.44082 

This case has also been studied in the physics literature, see e.g. |MLA07| . 
in the form of a three-dimensional lattice gas, where colourings are weighted 
according to their number of Is. Mathematical results one the structure of 
the set of colourings have shown [GalOSi IGK04| that many of the ordinary 
Monte Carlo algorithms used to study this model numerically have slow mixing 
properties and that there are interesting long range correlations in the positions 
of the Is. 

6.1 Computational results 

We first used the standard transfer matrix method in combination with the 
compression method of |LM08| to compute the largest eigenvalue for both the 
periodic and aperiodic graphs needed to bound the capacity for this channel. In 
order to verify our program we recomputed the eigenvalues from jNZ03| and the 
results agreed. In Table [4] we show the eigenvalues not previously computed. 
Using these eigenvalues as in |NZ99[ IFP05| we find the following bounds for the 



ni 


"-2 


aperiodic 


periodic 


aperiodic /periodic 


3 


12 






769999.6006127802 


4 


7 


41543.31662520356 






4 


8 


184654.5439467464 


117151.9963311473 




4 


10 




215347.9226316121 




5 


5 


13427.06985344107 


8185.111027254276 


10331.06553679985 


5 


6 


85738.84889761954 


51133.96879131764 


68793.17993810770 


5 


7 


547489.0319884565 


307078.2654460451 




5 


8 






2779905.231816480 


6 


6 


786528.5060953929 


482862.3074476483 




6 


8 




37133338.84386827 





Table 4: Largest eigenvalue for the standard transfer matrix 

exponentiated capacity: 

1.4365871627266 < e''-'^^^ < 1.43781634614 (6.1) 

We have here determined one more decimal in the value of e''^^'"^ and limited 
the next decimal to only two possible values. 

The largest eigenvalues for the 1-vertex transfer are given in Table [5] As we 
can see the eigenvalues give a reasonably good approximation of the capacity. 
Even for a small case like (4,4) the first three decimals agree with the bounds in 
16.11 For the largest case the eigenvalue is in the interval given in 16.11 but here 
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we do not have an error bound. At first sight the values given by the 1-vertex 
transfer matrix looks less impressive for this case, but in fact the best bounds 
before the current paper only gave e''^^'"-' = 1.4. Hence even the (4,4) case for 
the 1-vertex transfer matrix gave an estimate with improved accuracy. 



ni 


n2 




4 


4 


1.431707 


4 


5 


1.433880 


5 


4 


1.433943 


5 


5 


1.439764 


6 


5 


1.436801 



Table 5: Largest eigenvalue for the 1-vertex transfer matrix 



6.2 Computational costs 

The most striking feature for the three-dimensional case is the difference in 
computational resources needed for the two approaches. 

The computation of the eigenvalues for Cg^s used 3700 GB RAM and ran 
for 10.6 hours on 512 4-core CPUs on a linux cluster, giving a total of about 
21700 CPU- hours. The program was a Fortan 90 program using OpenMP and 
MPI for communication. Before compression the matrix had side 1682382. 

For the 1-vertex transfer matrix constraints, in programming time and com- 
puter access, made us settle for a single machine implementation of the method 
in Mathematica which was run on a desktop Macintosh with 2GB RAM. For 
ni = 6, 712 = 5 the computation used 52 CPU-hours. The matrix has side 339 
000 but since it has only two non-zero positions in each row the amount of RAM 
used was negligible. 

Matrix Time RAM 

ni = 6, 712 = 5 1-vertex 52 CPU-hours 5MB matrix 

Cg X Cg periodic 21700 CPU-hours 3700GB matrix 

Table 6: Computational costs for three-dimensions 



7 The monomer-dimer model 

The classical monomer-dimer model on 1/^ consists of tiling Z'* with monomers 
and dimers in the direction = {5\i^ . . . , 5di)^ for i = 1, . . . , d. This tiling 
can be coded in 2d + \ colours, see |Fri03[ IFP05| . That is, the colour 2d 1 
corresponds to a monomer, and the colours 2z — 1, 27 correspond a dimer in the 
direction e.^. So F^ = ((2d -I- 1), Ei) is given by the following conditions on Ei 
ioT i — 1, . . . , d. 
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• All vertices (2(i+ l)\{2i — 1, 2i} form a complete directed graph on 2(i — 1 
vertices. 

• {j,2i - l),(2i,j) e E., for all j e {2d + l)\{2i - 1 , 2i} . 

• {2i - l,2i) e E,. 

Denote by hd the monomer-dimer entropy, e.g. |Fri03[ IFPOSj . Let n = 

(rii, . . . ,nd-i) G N'^~^. Define the 1-vertex transfer matrix P^^d as in the pre- 
vious sections for d = 2,3. We claim that 

hd^ lim logp(P(„ „ (7.1) 

ni,...,nd-i-+oo 

In this case the colour 2d + 1 is not friendly. It is shown in |FP05j that to 
compute the d-dimer entropy hd it is enough to consider the tiling of the box (j) 
of (ni) X ... X (ud) with monomers and dimers that fit inside the box. In this case 
we can extend the tihng cj) to the tiling <p of {ni + 1) x . . . x (n^-i + 1} x (ud) by 
adding an additional layer of monomers. The arguments of the previous section 
yield the equahty (|7.1|) . 
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